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Abstract 

Computational aspects of the optimal consumption and investment with the 
partially observed stochastic volatility of the asset prices are considered. The 
new quantization approach to filtering - density quantization - is introduced 
which reduces the original infinite dimensional state space of the problem to 
the finite quantization set. The density quantization is embedded into the 
numerical algorithm to solve the dynamic programming equation related to 
the portfolio optimization. 
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1. Introduction 

The optimal investment portfolio and consumption path choice have been 
studied extensively for about 5 decades but still poses computational diffi- 
culties. The standard Merton-like investment problem evolved into many 
research fields and one of them are the partial observation models studied 
by Lakner [15] . Pham and Quenez [19], Sass and Haussmann [21], Stettner 
[24j . Baghery and 0ksendal pQ, Halaj [13], Brendle [Bj. Those models are 
imbedded into the control theory framework with partial information [3] . In 
the case of portfolio choice in the partial observation, the investor does not 
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observe all the factors defining the dynamics of the market. Hence, the op- 
timal strategies are not only functions of the state variables like the wealth 
of the investor, but depend on investor's beliefs about the true value of as- 
set prices and economic factors [21]. Those beliefs are represented by the 
probability distribution of values of the factors given available information 
on the market. This makes the value function of the investor to be defined on 
the infinite dimensional state space. Following the quantization approach we 
introduced the numerical method to solve the related dynamic programming 
equation. 

The partial observation shows up in the portfolio models in two forms. 
The first one is related to trend parameters of assets prices, the second one to 
volatility. Models with an unobserved trend are usually easy to reformulate 
in a full observation setting (eg. by the change of measure approach the drift 
parameter of diffusion price processes vanish). The portfolio problems with 
unknown volatility are, however, more realistic and we assumed in our model 
that the volatility of stocks is unobserved, also driven by some unobserved 
economic factors. This is a standard assumption in advanced models of 
volatility [21 [12]. 

We consider the numerical approximation of the solution to the follow- 
ing consumption and investment problem. For clarity of the presentation 
of the main idea we postpone the rigorous assumptions to the section 1.2| 



Let us denote by T the set {0, 1, . . . , T} C N fl {0}. We consider the prob- 
ability space J 7 , P) and the discrete filtration F: = {F^t&r- On T we 
define N sequences of the IID random variables {e;(t)}feT, i £ {1, • • • ,N}, 
each of which has a positive density 0. By {r(t)} teT we denote a process of 
the interest rates in the economy, constant within the periods [t, t + 1] and 
by {So(i)}teT we denote the bank account process given by the recurrence 
S (0) = 1 and Vn > S (t + 1) = (1 + r(t))S (t). 

We assume that the process of the economic factors measuring the eco- 
nomic situation is denoted by {Y(t)} te j and given by the following equation: 

Y(0) = y Y(t + 1) = Y(t) +a(y- Y(t)) + a Y £(t + 1), (1) 

where (£(£)) t e T is the IID sequence of i^-dimensional random variables, each 
with positive density if), ay is the full-rank K x K matrix. The tradable 
assets on the market have the following dynamics for % e {1, . . . , iV}: 

Si(t + 1) = Si(t) exp (fi(Y(t + 1)) + a(Y(t + l)) £i (t + 1)) . (2) 
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There are two types of shocks on the market: the idiosyncratic e which are 
asset (eg. company) specific and the systemic £ which influence all the risky 
assets on the market. 

The investor (and consumer at the same time) have preferences charac- 
terized by utility functions u : R K x R + ->■ R and u T : R K x R+ ->■ R. 

The return from investment in the asset Si in t for [£, t + 1] is denoted by 
Ri(t + 1) = ^j 1 - The logarithmic return is denoted R\{t) = ln(i?;(t)). The 
wealth of the investor starting with capital xq and investing it : = {n(t) \t G T} 
and consuming c: = {c(t)\t G T} is defined by: 

X(t+l) = ^7r J (t)^-^ + (X(t)-^ 7 r,(t)-c(t))(l+r(t)), X(0) = x . 
i=i ^ ' i=i 

(3) 

The investor observes only the prices Si of the securities so his informa- 
tion is described by filtration ¥ s = {Ff}^ where J-'f : = a({Si(s)\i G 
{1,...,N}, s < t}). It is equivalent to observing ¥ lR : = a({R\(s)\i G 
{1,...,7V}, s < t}) generated by log-returns from investment in S which 
is more convenient for our purpose. The investor wants to optimize his util- 
ity from consumption and his terminal wealth. She maximizes the functional 
J : A(x) — > R given by: 

J(c,n) = E j|^(c(t)) + 5 T u T (Y(T),X^(T)) J , (4) 

where T is the time horizon and A(x) is the set of the admissible controls 

(c, tt) 

A(x) = {((c(0), . . . , c(T - 1)), (tt(O), ...,tt(T-1))| 

(c(t), n(t))- ^-measurable; < c(t) < X c,7r (t); 

N 

$>(t)<X c -(t)-c(t)}. 

1=1 

The solution maximizing J is given by the special form of dynamic pro- 
gramming. 

V(t,x,g) = sup \u(c) + 5Ev(t + l,x(R l (t + l)),Q t+1 (t + l,tt(t + l))^[ 
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The arguments t and x refer to usual time and current wealth state space 
variables (like in Bertsekas [5]). The variable p measures the distribution of 
a random variable which is precisely defined in section [2] and corresponds 
to the process Y. Unlike in the full observation stochastic control in which 
case the value function at time t depends on the realization of Y(t), the 
partial observation allows the investor to assess only the most likely value of 
Y(t) given the history of the asset prices. That is the intuition behind the 
dependence of V on the whole distribution of Y given J-'f . 

The lack of closed form solutions to consumption/investment problems 
gives rise to research on numerical simulation methods to be applied to mod- 
els with partial observation. The numerical procedure has to be designed 
in a special way to account for the natural high complexity of the state 
space of stochastic control. The literature does not give many examples of 
approximate solutions to the stochastic control with filtering. Runggaldier 
and Stettner [20] discretize transition probabilities and Desai et al. [10] pro- 
posed a particle filtering method to discretize a dynamic programming equa- 
tion. There are numerous studies of numerical methods of filtering equations 
themselves. The Zakai equations which describe densities of unobserved pa- 
rameters evolving in time as new information arrives to the market can be 
solved by means of the so-called particle filter methods [9]. Filter equations 
in discrete time can be estimated with the so-called quantization [TBI El HE] ■ 
In the related paper Corsi et al. [S] also proposed the scheme to solve the 
dynamic programming equation of the partially observed control problem 
applying markovian quantization and approximated the given Markov Chain 
by the transition probability matrix. In this way, infinite dimensional ran- 
dom variables can be approximated by a finite set of point in an optimal way. 
We modified the standard quantization techniques to develop a different ap- 
proach - density quantization - and we applied it to our control problem. 
Basically, the main idea is to find the optimal quantization set directly in 
the set of the unnormalized densities of the filter. In other words, the density 
quantization set is the set of the appropriately selected unnormalized den- 
sity functions. It proved to be successful in recursively solving the dynamic 
programming equation. 

The paper is organized as follows: First, we present the mathematical 
model of the market and decision making. Second, we show the influence 
partial information can exert on consumption of an investor in a simplistic 
theoretical example. Third, we rewrite the partially observed problem in 
a full observation setting, applying the change of measure approach and 
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we solve it using the dynamic programming. Fourth, we define the density 
quantization and we show how the investment / consumption problem can be 
solved numerically. Finally, we illustrate the application of the developed 
numerical method in the example of the market model. 

1.1. Notation. 

• M nxm — the set of matrices M with n rows and m columns. 

• ^"(J 7 ) — the set of Borel functions f:Qx R K — >■ R, f(co, •) € L n (R K ). 

• (f)fj, ta (x) — Gaussian density i.e. 

«W*) = ( 27r )^(det(S))V 2 eXp (-^^ - ^ T ^ X - 

where /x is mean and £ : = <ja T is covariance matrix. 

• vol (A) — volume of a set A e R n . 

• diam(A) = sup {x , y)eAxA (J2i<i< n \ x i ~ Vi\ 2 ) 1/2 - 

• A c — completion of set A. 

1.2. Main technical assumptions. To show convergence of solutions 
of approximate problem to the original one we need 3 assumptions for and 

[AO] er(-) is bounded from 0, i.e. 3a min > such that Wy G R K a(y) > o" min . 
[Al] u and u T satisfy J r n xR k ((j)(x) + ij(y))(u(exp(x))+u T (exp(x),y))dxdy < 
oo. 

[A2] For every y E R N and a < 1, J RK 0(^) ^- } dz < L*. 

[AO] and [A 2] are necessary to show convergence of the numerical scheme. 
[Al] guarantees the integrability in the dynamic programming equations. 

2. Filtering 

The most fundamental task to be done before applying the standard 
dynamic programming toolkit to our consumption/investment selection is to 
transform the problem into the complete observation one. We apply changing 
of reference measure techniques similarly to Krishnamurthy and Le Gland 
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Elliot and Miao [12], Stettner |24J. After that, in the section [3j we 
transform the classical dynamic programming equation to make it suitable 
for our portfolio problem. 

For each t 6 T we define a random variable 



<P (a- l (Y(t))[R^(t) - n(Y(t))}) ^{°Y l \Y(t) ~ Y(t ~ 1) ~ ~ Y(t - 1))] 
A * ~ det^^t)))^')^)) det(c7y)^(y(t)) 

Let us construct a process A in the following way: A t : = Yi s =i A s . 

The process A defines a new measure - the reference measure P. Let us 
define the filtration F m ' y : a({R l (s),Y(s)\i G {1, . . . , N}, s < £}). For each 
i G T, its restriction to J r ] |' R ' y is defined: 



dP 
dP 



A,. 



To study properties of stochastic processes under P we extensively use the 
generalized Bayes formula: for (J 7 , P)-measurable Z 

We assume that there exists a function- valued process £> : OxTx M K — > 
L 2 (IR) satisfying for a L 2 Borel function / we have 

E [A t f(Y)\ P t R ] = I f(z)g t (z)dz, t E T. (6) 

JR K 

For a given t the object gt is the conditional unnormalized density of Y. 
We look for the recursive equation for g which - combining with the Bayes 
formula [5] - would give the tractable expression for filters used in the op- 
timization. It makes the numerical simulation of the optimal consump- 
tion/investment strategies easier. 

The main result of the section, relying on independence of Y and R l under 
P is given in the following theorem. 

Theorem 2.1. Let us denote 

<j>{o-\z)[RV{t)-n{z)\ 

®(z,R l (t)) : 
*(z,Y(t-l)) : 



det(<r(z)) 

^(a- l [z-Y(t-l)-a(y-Y(t-l))]j 
det ((Ty) 



The process g satisfies the recursion 



Proof: (see appendix Appendix A) 
Note that 

Bra|J «l = A^WpWdf. 

V Qt{z)dz 

This representation allows us to rewrite the original problem to the full ob- 
servation control. Since A is a martingale then - similarly to Runggaldier 
and Stettner UU\ - we obtained 



J(c, tt) = EA T J <5*«(c(*)) + S T u T {Y{T),X c ^{T)) 
{ t=i 

T 

= [AtS'uicit))} + E[A T 5 T u T (Y(T),X^(T))} 
t=i 

T 

= J^E [E [A^(c(t))| 7-f ]] + E [E [A T 8 T u T (Y(T), X c ^(T))\ j^]] 

= E { V 5'u(c(t)) + 5 T [ u T {z, X c '*(T))g T (z)d 
1^ Jr* 



(8) 



In this way all the processes used in the equation [8] are observed, i.e. adapted 
to the filtration generated by the observed process R l . 

Remark 2.1. There is an analogical way of solving the filters in the con- 
tinuous time. The density of the filter is described by the so-called Zakai 
equation. For instance, Benes et al. |5j/ showed the existence of the solution 
to the Zakai equation in the theoretical case and Carmona and Ludkovsky J7|/ 
used this equation in the financial setting. 

3. Dynamic programming 

After transcribing the original problem to a Markov one we can formulate 
a dynamic programming equation for the optimal wealth of an investor. Un- 
fortunately, this is an infinite-dimensional problem since the value functional 
of the optimization is a function on the space of the random densities. 
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Let At(x) be the set of the admissible controls of the portfolio starting 
at time t from wealth x (initial at t) i.e. 

A t (x) : = {((c(t), c(t + 1), . . . , c(T)), (7r(t), tt(* + 1), . . . , vr(T)) |(c, vr) G ^(s)} 

T/ie optimal value V at time t e T with the initial wealth x and the updated 
density g of the unobserved process at t is defined V: Txlx B 2 (F) — >■ M 



V(t, x, g) : = sup E 

(c,7r)eA(a:) 



V 6^(0(3)) + 5 T - 1 ! u T (z, X^(T))g T (z)dz 
for X c,7T (t) = x and Qt = g. The previous section gives 



IR 



V(T,x,g)=E 



u T {z,X c >*(T))g T (z)dz 



-plR 



Ut(z, x)g(z)dz. 



Lemma 3.1. The following backward recursion holds for V and t < T: 

V(t,x,g) = 



and 



sup 

{(c,n)eRxR N \0<c<x. 
N 



f f N 

\u(c) + 5 / vtt + l^TTiRi 



N 



+ (x - J^Tfi - c)(l + r(t)), et+i) • - • &Rn m 



i=l 



i=l 



sup J(c,tt) = V(0,x ,ip). 



(10) 



Proof: It is straightforward that the identity 10 hold. 
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By definition, T\ -measurability of (c(t),n(t)) and T\ C 



T „ 

\/(t,x,^)= sup {E[Vry C (s)) + 5 T - f / u T (z,X c ^)g T (z)dz\P t R ]} 
(c,7r)eA t {x) L ^ Jr^ 1 J J 



sup |u(c(*)) + [ ^ <5 s - (m) «(c(s)) + 

(c,ir)eAt(x) s =t+l 



sup 

(c,ir)eAt(x 



5E 



E 



<5 T " (m) / u T (z,X c ' n )g T (z)dz jfl) 



s=t+l 



[u(c(t)) 



S T - (t+1) J rk ut(z, X^) QT {z)dz\^] P R ] } 
[u(c(t)) + 5E [V(t + 1, c(t), tt(0, #(i + 1)), ft+i) \H R ] } 



sup 

(c,7r)6^ t (x) 



Using definition of A t , it is easy to check that R\(t + 1) has the density 
under the measure P. Let us define 



N 



N 



x(t,x,c,Tt,R) = ^Tiie Rl + (x - J^TTi - c)(l + r(t)). 



i=l 



sup (u(c(t)) + <JE[yf* + l,x(x, c(t),n(t),R l (t + 1)), 

H;R l (t + l)) f 
<f>(R l (t + l)) J RK 

[u{c) + 6 I v(t + l,x(x,c,n,R), 



*(;y)Qt-i(y)dy) 



IR 



sup 

(c,Tt)eA(x) 



g(vg) 

<f>{R) 



r N 

/ *(-,S/)&-i(j/)dj/) H^R^m ■ ... ■ dR N \ 



□ 
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3.1. Quantization. The set B 2 (T) is infinite dimensional. Hence, V in 
the form of the equation [9] cannot be computed numerically. It has to be 
approximated by a sequence of the functionals V on the finite state space. It 
is a very complex numerical problem. To this end, Runggaldier and Stettner 
[20] proposed the scheme for the numerical filtering based on the Hidden 
Markov Model approach. They discretized the infinite-dimensional equation 
of the transition probabilities on the finite state space and then could solve 
the dynamic programming equation on the set of vectors in M M . The grid 
was chosen arbitrarily. The partition in this grid method is straightforward 
but easily gets untractable as the number of nodes in the partition of the 
codomain increases. With only 5 grids the number of the approximate value 
functions, which has to be computed amounts to 5 5 = 3125. 20 grids give 
104857600000000000000000000 variants! 

A much more applicable extension of this approach is the density quan- 
tization introduced to limit the number of the unnormalized densities in the 
set of arguments of the value function and to optimize the structure of the 
grid. 

To reduce dimensionality of our problem from the infinite to finite space 
we follow the idea proposed by Stettner [21]. We discretize the codomain of 
the densities g. We take a partition of each coordinate of R , i.e. for the coor- 
dinate j we take the set of m$ increasing real numbers {zn\l), . . . , 
We approximate random densities g by the functional on the grid 

K 

Zn- =II{#( 1 ).-.#K W )}C» Jr - 

i=i 

The cubes B n (ki, . . . , kx) '■ = nJLiMv z< n\kj + 1)] give the partition of 
the support of p t . The sum of the sets B n is denoted 

<Bn= |J B n {h,...,k K ). 

{(fel,...,fcx)|l<Jfc<<ml i) } 

We assume that 

lim vol(Q3 n ) = +oo, 

n— >+oo 

VI < j < K lim max \z { n j) (i + 1) - z®{i))\ = 0. 
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Similarly, we define the partition of the codomain of p t : G n : = {g n (l), . . . , j„(m„)} 
such that g n (i + 1) > g n (i), lim^oo g n = oo and max* \g n (i + 1) - g n {i) \ -> 
as n tends to +oo. 

The idea of the quantization is to focus attention on the set of density 
functions and to project all random densities on this set. Unlike in the 
grid method where the projections are made inside every subset B n on the 
grid G n , the number of outcomes can be quite small. Intuitively, under 
mild conditions the densities form a "tight" family of functions and many 
of them are very close to each other (in sup norm). There is no point in 
distinguishing between them since they lead to similar value functions. The 
idea of quantization gave fruitful results in finding transition probabilities for 
nonlinear filters considered by Pages et al. [TF]. It happens to be useful in 
the dynamic programming as well. 

The fundamental idea of the approach is to project random densities 
on a set of functions that have only finitely many values and vanish at all 
point sufficiently distant from 0. The set of functions will be called density 
quantization set (or shortly - quantization set). 

Definition 3.1 (Density quantization set). Any set of functions q: M. K — > 
G n , which are constant on the sets B n (k\, . . . , kx), K € {1, . . . , m$ } and are 
equal to on 03^ is called density quantization set and is denoted Q n . The 
number of elements of the set Q n - #<2 n - is denoted N n and tends to +oo 
with n — > +oo. 

The projection Projf™ of a random density g on Q n is defined 
Pro jf;M : = ar g min {<7eQ n } max , , \Q(u,zS' ) (k 1 ),...,zV c) (k K ))- 

{(fc 1 ,...,fc i^ )|l<fc ^ <m5 l ^, } 

q (z£\k 1 ),...,zW(k K ))\. 

The proper behavior of density quantization is guaranteed by the so-called 
Zador Theorem [T7j 

Theorem 3.1. Let X be n-dimensional random variable such that X 6 L 2+s , 
5 > 0, with density f n . Let Qk C W 1 and the projection Projg K : R — > Qk 
be defined as Projg A , [x] = argmin 9g Q x \\q — x\\. Then 

n+2 

D n (Q K ): = min E||X-Proj Qjr (X)|| 2 < K~* jJ [ f n (x)^dx) " , 
where J n ~ 
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The quantity D n (Q n ) is called the distortion of the quantization. 

The straightforward application of the Zador Theorem gives very slow 
convergence. The structure of the stock market model allows to show that, 
in fact, the numerical scheme have much better properties if we assume Lip- 
schitz continuity of •)/</>(■). 

Let us discretize the space of values of R and consider the set Qn . = 
{fi, . . . , f n |fj G WL N }. Let the function g be defined as 

g(z,R): =§{z,R)l<j>{R) [ ^(z,y)g(y)dy. 



From now on, we can think about G n as of the set generated implicitly by 
G n = {g(z^(l),n) \j G { 1 , . . . , n} , Z G {!,..., mffl },i G {!,..., n}}. 



Q [ n\ i.e 



The quantization set from definition |3.1| corresponding to is denoted 



Q n (R). The set of all the sets Q n is denoted Sn. A separate discretization 
is defined for the portfolio process X, but in the standard way followed in 
the numerical solving of the dynamic programming equations (in the full 
observation setting or even in the deterministic setting). The projection set 
is = {x\, . . . , x n } and the set of the projection sets is denoted S x . 
Let us define the sequence of functionals V on T x K x -B 1 (J r ) as 

V(T,x,g) = / v,T(z,x)g(z)dz 

V(t,x,g) = sup {u(c) + 6EV(t + l,PToi Qx [x^(R)},Piof[g(R)]l}l) 

C,TT&A(t) 

Note that 

V(T,x,q) = V(T,x,q) 

for x G Q x and g E Q. In the following part of the subsection we showed 
that V approximates V. 

For brevity, if it does not lead to confusion, let us denote x: = Proj Qx [x] 
and g: = Proj c [g]. 

Lemma 3.2. Ifur(-,z) is L 2 -Lipschitz continuous and bounded by L\ then 
\V{T,x 1 ,g 1 )-V(T,x 2 ,g 2 )\ 2 <2Ll [ \ gi (z) - g 2 (z)\dz + 2L 2 2 \ Xl -x 2 \. 
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Proof: 



\V(T,X U Qi) - V(T,X 2 ,g 2 )\ 



u(xi,z)gi(z)dz — / u(x 2 , z)g 2 (z)dz 
u(xi, z)qi(z) - u(xi, z)g 2 (z) + u(x 1 , z)g 2 (z) - u(x 2 , z)g 2 (z)\ 2 dz < 
2L\ I \ Ql {z) - g 2 (z)\ 2 dz + 2L 2 2 \ Xl - x 2 \ 2 . (12) 



□ 



Definition 3.2. The value function v is (e,co,ci) -Lipschitz continuous if 
and only if there exist constants c and C\ such that for each pair (x±, x 2 ) and 
{Qi, Q2) 

\v(xi, qi) - v(x 2 , g 2 )\ 2 < e + c |xi - x 2 \ 2 + c x \ \qi(z) - g 2 (z)\ 2 dz. 

Jr k 

Lemma 3.3. Let g(z, •) be Lipschitz continuous and is p- decaying for p > N 
i.e. 

3a 2 > g(z,x) < a z \x\~ p . 

Let us assume that vol(B(k)) < U^\ K ■ Let us denote the distribution of 

xf*\R) by p Xi e L\ and xf*\R) by f% e L\ . Then, for (e,L x ,L e )- 
Lipschitz continuous function V 

err n : = min E\V (t , xf'^ (R) , gAR)) - 

{Q x GS x \#Q x =n} 
{QeS Q \#Q=n} 

V(t, Proj Qx [x£*\R)],Proi% [g 2 (R)])\ 2 < 

2L X (1 + r(t)) 2 \ Xl - x 2 \ 2 + 2L e L%L% [ \ Ql {z) - g 2 (z)\ 2 dz + 

Jr k 

L * n ~ 2jl -(Jj x ( x ^ dx ) + 2L ^^(^) 

iff N \ " M P 

AL s M K n-Nj N / f™( x )wdx + 2L e a z v N ^— + e, 

\JR N J p — L 



K+l 

+ 



where 



N-2 , , 
(2^)^ +1 



V N 



T{ , if N = 2k 



(N-p)(N-2)l 

N-3 1 1 N-l 

(N-p)(N-2)v. ' rfN = 2k + l 
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and f™ ax is density of g(R)(zk) for k such that 



N+2 ■ 
N 



Proof: By Lipschitz continuity of V and the the inequality \a — b\ 2 < 2a 2 +2b 2 

AV: = iVit^f'^ify^tiR)) - V(t,Pm] Qx [xf*\R)),Projz®[Q2(R)))\ 2 < 

e + 2L x \xf*\R) - Vm] Q [xf*\R)}\ 2 + 2L e [ \g(R)(z) - Projg>(it!)](*)| 2 dz < 

4L x \x ( r\R) - x^\R)\ 2 + 4L x \x { r\R) - Proj Qx [x£*\R)] \ 2 + 

AL e [ \g 1 (R)(z)-g 2 (R)(z)\ 2 dz + 4L l ,y2 I \&( R )( Z ) ~ 9k\ 2 dz + 

4L e [ g(R) 2 (z)dz 

for a set of g k s, g k G G n . 

Firstly, let us make an easy observation that 

\xf*\R) - xf*\R)\ 2 = (1 + r(t))\ Xl - x 2 \ 2 . 

Secondly, we can use the quantization on Q x to estimate the approximation 
of the random variable x 2 c ^\R) with Projg x [x^\R)\. Since x^ c,/K \R) is the 
sum of the random variables of the form piexp(R), R ~ 4>{-), then from the 
Zador theorem (see theorem 3.1| we get 



max n-'jj [ (f$;~»«(x)y*Ax) , (13) 

where f^"' ,VN {■) '■ = {(ppi * ••■ * 4>m)(-) is the convolution of densities of the 
random variables Pi exp(R). The maximum always exists and we skipped the 
justification to the remark 3.1 We denoted the corresponding f^'"' PN by 
fx- 
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Thirdly, by the assumption [A2] 



\ Ql (R)(z) - g 2 (R){z)\ 2 dz 



r $(z,rw) r 

J RK [ J R1 



^(z,y)g 1 (y)dy - 



<5>{z,R ( V) 



<5> 2 (z,R^) 



^(z,y)g 2 (y)dy 



dz < 



f § 2 (z R( l >) ( f \ f 

L teLl^jQiM-Mldy) <L%L% Jj Ql {z) - g 2 (z) 

Finally, since g 2 (R) is globally Lipschitz continuous (there is a common 
Lipschitz constant L R for all R{u)), 

[ \g 2 (R){z) - g k \ 2 dz < 2 I \g 2 {R){z) - g 2 (R)(z n )\ 2 dz+ 

J B(k) J B{k) 

2vo\(B(k))\g 2 (R)(z n ) - g n \ 2 < 2L 2 R vo\(B(k))di&m(B(k)) 2 + 
2vo\(B(k))\g 2 (R)(z n ) - g n \ 2 



Then, 



err n < e + 



2L x (l + r(t))\x 1 -x 2 \+2L e L%Ll [ \ 6l {z) - g 2 {z)\ 2 dz+ 

Jr k 



2L e L 2 R vo\(B(k))di8,m(B(k)) 2 + 2L x n' 2 J 1 [ / (f x (x))* dx ) + 



4L 2 Q E 



■ J 1 ^ ! Yl vo\(B(k))\g(R)(z k ) -g k \ 
{QeS Q \#Q=n} j—f 



k£K n 



+ 2L, 



. [ g(R) 2 (z)dz. 



The sign "XT can be swapped with "min" since for each 2 elements of the 
sum, the minimum is calculated with respect to 2 different arguments. Zador 
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Theorem and assumption on B(k) imply 

err n < e + 2L x (l + r(t)) 2 \x 1 - x 2 \ 2 + 2L e L%L% I |^i(^) - ^ 2 (^)| 2 d^ 

JR K 



L x n 2 J x ■ ^/ x (: C )3dx) 3 + 2L e L 2 R ■ + 

K JV+2 
keK n 

<e + 2L x (l + r(t)) 2 \x 1 -x 2 \ 2 + 2L g LlLl I |^i(^) - ^ 2 (^)| 2 d2: 
L x n\h ■ (fx{x)Uxf + 2L e L 2 R VK (^) + 



N+2 
N 



AL e M^n-Nj N [ f™ ax (x)^dx) +2L e a z \x\- p dx 

\JR N J J[M () ,+oo) N 

The calculation of the constant v n is left to the Appendix. 

□ 



Remark 3.1. The minimum with respect to pis in formula 13 L(((</>pi * ... * 

<j)^))(x))^dx always exists. Let us show it in the case of N = 2. The other 
cases are analogous. 
We have 

F( Pl ,p 2 ) := / {((<P^*...*^))(x)ydx 
Jr 

i 

X , / a \ ( x z \ , 1 \ ( z 1 



(,(e) 



dz dx (14) 



PlP2 \ Pi J \P2, 

and obviously, by the definition of <pp , F(0,p 2 ) = F(pi,0) = 0. It is 
straightforward that F is continuous on the compact set [pi,Xi] x [P2, ^2] 
and /|[pi,xi]x[p2,a;2] attains the maximum. 

To show that F has maximum on [0, x\] x [0, x 2 ] it is sufficient to prove 
that F has negative (and continuous) partial derivatives on (0,pi) x (0,^2), for 
somepi andp 2 . Let us concentrate on the partial derivative with respect top\. 
Firstly, we majorize (j>^ by an integrable function ipw with the monotone tails 
in the sense that for every i <fy^{x\, . . . , •, Xj+i, . . . , Xn) is increasing 
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for sufficiently large negative arguments and decreasing for sufficiently large 
positive ones. It is always possible for the bounded density function. For 
some mild conditions we can swap the derivative and integrals. 



dF(p 1 ,p 2 ) 



dpi 



1 

P2 



1 

2 
Pi 



1 



P1P2 
x — z 



\(e) 



x — z 



Pi 



Pi 

- V0 (e) 



1(e) 



dz 



z 

P2 

x — z \ x — z 



Pi 



Pi 



(e) 



Z 
P2 



dzdx. 



The expression in the square brackets is negative for sufficiently small p\. 
The first component is always negative. If Xi — Zi > than for pi large 



enough ( ) V$ 



(e) ( x-z 
Pi 



< 0. On the other hand, Xi — z\ < implies 



Pi 



V0, 



00 



X — Z 



Pi 



> 0. 



Thus, on [0,pi] x [0,^]; F is bounded by a function that has the maximum 
value. This completes the proof. 

A direct consequence of lemma |3.2 is the following estimate of the approxi- 
mation error of the algorithm. 

Theorem 3.2. ForuT{-,z) L u - Lip schitz continuous and ut{-, •) bounded by 



\V(0,x,q)-V(0,x,W<S 



Ofi.Mn ~r 



1-5 

(1) 



Lrp X X\ ~\~ L 



(2) 



\g{z)-e{z)\ 2 dz, (15) 



with 

Cn t M 



L u n- 2 Ji- Qjxix^dx^J +2L^L 2 R VK 



Mo 
n 



K+l 



+ 



(i) 

T 
(2) 



4L^M*n-Kj N 
t=i 



N+2 
N 



M, 



N-p 



>a z v N 



p — 1 
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Proof: Let us suppose that the projections realizes the minimal error over 
the set of projection sets and V(t + 1, •, •) is (e, L x , Lj-Lipschitz continuous. 
In this case, applying lemma |3.2[ 

\V(t,x,g)-V(t,x,g)\ 2 
< ( sup \u(c) + 5EV(t + l,x(R),g(R))- 



+u{c) - 5EV{t + l,x{R), g[R))Y~ 



< sup <J 5E 

(c,w)£At(x)UAt(x) 



V(t + 1, x(R), g(R)) - V(t + 1, x(R), g(R)) 

5e + SC nM) + 28L X {1 + r{t)f\x - x\ 2 + 25L e L%L% [ \g{z) - g(z)\ 2 dz. 

Jr k 



Thus, V(t, •) is (6e + 5C nMo , 25L X {1 + r(t)) 2 , 28L g L I.L^-Lipschitz contin- 
uous. By induction the proof is completed. 

□ 

4. Numerical illustration 

We show the performance of the algorithm for an arbitrary parametriza- 
tion of the model. We consider the market for only one risky asset with the 
stochastic volatility driven by the one dimensional process y. Even in this 
case, the computation of the optimal consumption / investment paths is very 
much time consuming for the algorithm implemented on a regular computeiQ 

We assume that the dynamics of the market specified in general terms in 
the subsection [T] is given by the following system of the three equations: 

S Q (t + l) = (l + 0.03) m , 

Si(t+1) = Si(t)exp {0.05 + 0. 25(1 - 0.75exp{-F(t + l) 2 })e(t + 1)} , 

^(0) = 6.00, 

Y(t + l) = 0.80-y(t) + 0.20f(t + l), 

Y(0) = 1.50. (16) 

The risk-free interest rate (the bank account interest) is equal to 3%. We 
assume that the mean log rate of return from the risky asset is 5%. The 



1 1.6MHz dual core processor with 2GB RAM. 
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Figure 1: A trajectory of the price process and underlying parameter y, i.e. trajectory of 
the stochastic volatility. 
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Source: own calculations 



volatility of the risky asset can vary a lot in the model. It can be as large 
as almost 16% for Y{t) = 0.8 and as low as 6% if Y{t) = 0.0. For the 



parametrization in the equation 16 trajectories of Y usually oscillates within 
-0.8 and 0.8 bounds. 

The variability of Y is visibly reflected into the volatility of S±. A sample 
trajectory of Si is shown on figure [Tj 

The utility functions meeting the requirements of boundedness and Lip- 
schitz continuity demanded in the assumptions of the theorem 3.2 (in fact 



the lemma 3.2) were chosen to be the following: 



u T {y,x) 




and u(x) = 0.25 



x 



0.5 



K 2 + x, 



• (17) 



This are the utility function of the so-called IRRA type, i.e. the increasing 
relative risk aversion. 

The numerical algorithm to calculate the approximate optimal consump- 
tion / investment strategies was based on the backwards dynamic program- 
ming equation 11 We compute V recursively for 10 points of time with the 
time horizon T = 10. At each point of time equation 11 give us the estimates 
of the consumption c and the investment n maximizing his joint utility. 
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Figure 2: The initial quantization set Q„ (top graph) and the approximation of the optimal 
quantization set in the stochastic gradient descent methods in 500 steps (bottom graph) 




Source: own calculations 



Keeping in mind the complexity of the calculation of V(t, x, g) based on 
V(t+1, -, •) we have to chose a limited number of nodes for the portfolio value 
x and the beliefs g. To make the calculation tractable, we assume that the 
quantization set of the portfolio process X is Q x : = {0.00, 0.25, 0.50, . . . , 9.75, 10.00}. 
The investor's beliefs described by the unnormalized densities are projected 
on the appropriate quantization. 

Since the minimal error in the approximate algorithm described by the 
recursion 



11 is realized for the optimally chosen quantization set we apply the 



stochastic gradient descent algorithm to find the optimal structure (compare 

Pages and Pham [E]). We start with the initial arbitrary set of the densities 

Q° evaluated at the points from Z n : = {-1.50, -1.45, -1.40, . . . , 1.45, 1.50}. 

We choose the parameters - the mean and the standard deviation - to be 

the equidistant point on the real line, i.e. the mean took values in the set 

{ — 1.50, —1.25, 1.50} and the standard deviation in the set {0.1, 0.3, 0.5, 0.7, 0.9}. 

The densities are presented on figure [2j top panel. 

The procedure requires to construct the incremental function H which 
defines the corrections of Q Q n leading in the limit to the optimal quantization 
set. The incremental function is derived by the formal differentiation under 
E of the distortion function D n (Q) for a given realization f of return R l . 
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Figure 3: The selection of the essential elements of the quantization set Q^ 00 (25 out of 
65 elements) 
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Source: own calculations 

Namely, in the special case of 1-dimensional process Y any quantization set 
Q can be represented by the matrix from _A/f nxmn where (k,m) element is 
defined as the value of the kth element of the set Q evaluated at the mth 
argument from Z n . Then, the function H: J\4 nxm ^ x R — y J\4 nxm ^ j s defined 
as 

d 

H k>m {Q, r) : = T^Ofc, r) (g(z k , f) - g m {k)) . 

Since in the example the densities <fi and ip in the example are smooth then the 
derivative of g is well-defined. Then for a given sequence {/3j}j e N satisfying 
the usual regularity conditions = oo and ^ (3f < oo) the following 

sequence of the quantization sets converge to the optimal one (see Shapiro 
and Wardi [22] for convergence results): 

Q™ +1 = max { Q™ + P m+1 H(Q™, R l (u m+1 )), 0} . 

Applying this recursive procedure for with 500 iterations of m we ob- 
tain the modified set Q^ 00 which is graphically presented on figure [2j bottom 
panel. Firstly, one crucial advantage of Q^ 00 is the reduction of the domain 
of the densities from the initial [—1.5,1.5] to [—0.5,0.5] where they are es- 
sentially different from 0. This decreases the dimensionality of the numerical 
problem since the same number of points Z n can be denser allocated on the 
smaller interval [—0.5,0.5]. Secondly, we can drop the densities from 
which are very similar to each other and we take into account only a subset 
Q^ s C if the densities. Namely, we apply the following procedure: 

1. QT- = 2n°°; eps=0.1; 

2. REPEAT i 
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Figure 4: Evolution of beliefs with prior at time T — 9 equal to the normal distribution 
with mean 0.1 and standard deviation 0.2 
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Note: Each box shows a density which is recursively obtained using equation [7| i.e. 
the density on the box T — n is obtained from the formula [7] with QT-n-i equal to 
the density from the box T — n — 1 and qt-9 = <j>Q, 1,0.2 • 
Source: own calculations 

3. Chose a pair of densities qi G Q ess and q 2 G Q ess ; 

4 IF ^'ff' <e P s THEN Q n s -- = QT/M; 

5. i:=i+l; 

6. UNTIL i==5000; 

the application of which gives the quantization set consisting of 25 unnor- 
malized densities. 

It should be underlined that functions g representing the beliefs about 
Y, described by recursion [7], are not necessarily densities. They are unnor- 
malized densities. An example of the evolution of beliefs is presented on the 
figure |4j 

The number of nodes of the portfolio values, which is 41, multiplied by 
the number of the densities in the density quantization set equal to 25 gives 
1025 arguments of V(t, ■, ■). 

Searching for the optimal consumption and investment for a given point 
of time t, the current wealth x and the beliefs about the unobserved factors 
driving the volatility on the market, we discretize the space of investors deci- 
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Figure 5: Distribution of the optimal consumption for different points of time 




Note: histograms for 1000 simulation of the risky asset dynamics. T — n means n 
time periods before the time horizon T. 
Source: own calculation 

sions. We were looking for the maximum expected value of the value function 
V(t+1, x c '*(t+l), g t+1 ) among c G {0.00s, 0.05s, O.lOx, . . . , 0.95x, l.OOx} and 
7T G {0.00x, 0.05x, O.lOx, . . . , 0.95x, 1.00s}. 

The four main components of the solution of the numerical optimization 
were presented: the consumption, the investment in the risky asset and the 
risk-free asset and the value of the optimal portfolio. Assuming that the 
investor possesses 6 units of the initial capital we generated his wealth paths 
along the estimated consumption and investment policies. We perform 1000 
simulations of the risky asset prices and we construct the corresponding con- 
sumption and investment paths according to the approximate optimal policy. 

The results of the simulation suggest that the optimally behaving investor 
consume about half of the initial wealth during the first two periods and then 
gradually decreases the consumption rate (see figure [5]) . In the period t = 6 
the investor is left with less then 1 units of wealth. In the last three periods 
he consumes only about 0.1 units of his portfolio, almost irrespective of the 
market situation (i.e. independent of the evolution of the risky asset prices). 

Conversely, his investment decisions are much more dependent on the 
market trends and on the time of decision making. His stronger beliefs about 
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Figure 6: Distribution of the optimal investment into the risky asset for different points 
of time 
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Note: histograms for 1000 simulation of the risky asset dynamics. T — n means n 
time periods before the time horizon T. 
Source: own calculation 



unfavorable volatility (about y) decrease his propensity to invest into the 
risky asset. The investor allocates quite a small part of his wealth in the 
risky project S\ only in the first two periods (see figure [6]). The closer to the 
terminal time T the more he is inclined to allocate his current wealth into 
the risk- free asset Sq (see figure m). As the figure [8] indicates, the terminal 
wealth reaches almost units. 

Even though the set of beliefs seems to be only roughly approximated 
by 30 density functions, the simulation reflects the behavior of a rational in- 
vestor in a quite reasonable and intuitive way. However, the computational 
burden of the numerical procedure makes it difficult to support investment 
decisions on a market for multiple assets unless the complexity of the stochas- 
tic volatility part of the model is substantially reduced. In fact the minimal 
error of the estimate of the value function V that can be attained in the 
numerical example and given by the constant C n ,M multiplied by the factor 

1 XT 

S^jj- (see theorem 



3.2) is equal to 0.81 which is about 12% of the utility of 



the initial wealth. 

However, the proposed quantization framework follows the promising av- 
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Figure 7: Distribution of the optimal investment into the risk-free asset for different points 
of time 
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Note: histograms for 1000 simulation of the risky asset dynamics. T — n means n 
time periods before the time horizon T. 
Source: own calculation 



Figure 8: Distribution of the optimal value of portfolio for different points of time 




Note: histograms for 1000 simulation of the risky asset dynamics. T — n means n 
time periods before the time horizon T. 
Source: own calculation 
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enue of research on the portfolio optimization under the partial observation of 
the stochastic volatility. It shows that the nonlinear filtering can be tractable 
even in the dynamic programming setting. From the financial point of view, 
the incomplete information is a very important driver of the market dynamics 
and its influence on the economic agents' optimal choice is worse studying. 
Certainly, a more efficient numerical implementation of the algorithm is re- 
quired. 

5. Conclusions 

We solved the dynamic optimal consumption/investment strategy under 
partial observation of economic factors determining asset price movements 
by means of the numerical method. The special variation of the quantization 
technique reduced the originally infinite dimensional problem to the finite 
state space exercise. We successfully developed the algorithm to solve the 
consumption / investment problem on the stylized market for 2 tradable 
assets and 1 unhedgable economic factor. 

The extension of the paper can be devoted to a study of the stability of the 
algorithm solving numerically the optimal portfolio choice with consumption. 
The first important question remains how the results of the simulation change 
between two different sets of randomly generated asset returns. The second 
one could be related to the size of quantization set that would in practice 
give an assumed accuracy of numerical optimal strategies. 

We transformed the partial observation to the full observation problem, 
assuming that the shocks affecting prices and economic factors are indepen- 
dents. However, existing methods of stochastic volatility estimation [TTJ do 
not need shocks to be orthogonal. It would be interesting to develop a model 
of consumption/investment with imperfect observation and correlation of 
volatility and idiosyncratic shocks in the asset price movements. 

Appendix A. Filters 

The following lemma is the most crucial in obtaining filters of partially 
observed processes. It states that Ys and R\s are independent in (.F^, P). 
After disentangling Y from R l , the evolution of the variable Y can be refor- 
mulated to a recursive equation of measures on (fi,F ZR ). 

Lemma Appendix A.l. The processes Y and R l are independent in J 7111 
under P. 
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Proof: Let us take two Borel functions fx and f 2 - Then 

E [AT/ 1 fx (Y (t) )f 2 (R l (t))\ 7"^] 



E [fi(Y(t))f 2 {R l {t))\j r ^ 1 \ 



EfAr 1 !^] 

E[K 1 fi(Y(W2(#(t))\j** 1 ] 



(A.l) 



since A t 1 = X t 1 A i _\ and A t _ 1 is J-^-measurable. For brevity y: = Y(t — 1). 
Let us take the denominator in IA.1I and 



E [K 1 1 ^t-i] 



E 



E 



det(a(Y(t)))4>(RV(t)) 



det(a Y )^(Y(t)) 



<f>^(Y(t))[R {l) (t) - up®)]) ^y[Y{t) -y-a(y 
<f>(»(Y(t)) + *{Y{t))e{t)) ij(y- a{y - y) + <r Y (&)) 



-plR 
•> t-1 



det((7-i(y(t)))^(c(0) 



det((7yX£(f)) 



Put 



Pi 



Then 

E [K 1 1 -^t-i] — E 



^{y - <*(y - y) + qy£(*)) 

det(a^ 1 )^(e(t)) 



0(/i(y(t)) + f r(y(t))e(t)) 



det(a-i(r(t)))0(6(t)) 



y t-l 



The variable e(i) is independent of so we can integrate with respect to 
the density (f) 



E [AT 1 |^? 1 ]=E 



Pi 



0(My(t)) + or(y(t))e) 



(e)de 



-plR 

•> t-1 
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By changing variables with the diffeomorphism 6(e) = a 1 (Y(t))e, with a 
given fixed u, as follows f e , RN \ G(e)de = f RN (Q ° G)(e) det(0'(e))de we get 



E [A t _1 | J^t-i] = E \ P i [ 4>W{t)) + e)de 
^{y -oc(y -y) + oyf(*)) 



= E 



= E 



det(<Ty>(^)) 

i>(y - ot{y - y) + ^yj) 

r« det(^ 1 )V(0 



-plR 
•> t-1 

o{F l t-nFt-i) 



-plR 
•> t-1 



-plR 

J t-1 



1, 



observing that is independent of J 7 ^. 
Let us take 

E[X; 1 f 1 (Y(t))f 2 (B>(t))\J*?i] = 



E 



E 



Pifi(Y(t))Mlt(t)) 



.^(Ym + aiYitMt)) 



Pifi(Y(t))E 



f2(R l (t)) 



det( f r- 1 (^(O))0(e(O) 

0(/x(y(t)) + ( j(y(t))e(O) 



det(a^(^W))0(eW) 
A similar argument about independence of e(t) and gives 

E[AT7i(n*))/2(i2'(*))|^i] = 



-rlR 



t-l 



E 



fi(Y(t))Pi [ f2^(Y(t))+a(Y(t))e) 
Jr n 



6(^Y(t)) + a(Y(t))e) 



det(a-\Y(t))) 



de 



and after the diffeomorphic change of variables 

= E [/!(r(f))piE [/ 2 (i2«(0)|^i] I f\ r i] 
^{y -oc(y -y) +<T Y £(t)) 



E 



E 



•'t-l 



fi(y-<*(y-y) +<*yQ- 



det (cry 1 ) 

= E [E [/i(y(*))|^J ' E 1/2(^(0)1^!] | H\] 
= E[f 1 (Y(t))\^ R 1 ].E[f 2 (R\t))\T l t R 1 }. 



d|.E[/ 2 (rf(t))|^J 
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Taking fi(z) = 1a( z ) an d fz(z) = 1b( z ) for A,Be T lR we obtained 

P ({R l (t) eA}n {Y(t) e B} ) = E [h(R l (t))f 2 (Y(t))\ jf ] = 

= E [A(R l (t))\ P R ] E [f 2 (Y(t))\ P R } = P (R l (t) G A\P t R ,) P (K(f) e B\P R A . 



□ 



Proof: [Theorem 2.1| For an arbitrary Borel function / let us take 
f(z)g t (z)dz = E[AJ(Y(t))\P R ] = 

Jo-\Y{t))[R®{t) - fj,(Y(t))]) 1>(<T?\Y{t) -y-a(y- y)) 



E 



E 



Vr 



At-iE 



det(a(Y(t)))<p(RW(t)) 
<p(o-\Y{t))[R {l \t)-^Y(t))] 



det(a Y )^{Y{t)) 



f(Y(t)) 



IR 



det(<7(y(t))MJ2P>(t)) 
^(a Y x [Y{t)-y-a{y - 



f(Y(t)) 



E 



A t _i 



det(a Y )ij(Y(t)) 
Ja-^z^it) - »(z)]) i>(o Y x \z -y-a{y- 



IR 



RK det(a(z))<f>(RW(t)) 



det (cry) ip(z) 



f(z)ip{z)dy 



V 



■m 



The inner process is the function of Y(t — 1) and A t _i so we can integrate 
with respect to Qt~i{z) in the following 

$(z,R l (t)) 



f(z)g t (z)dz 



R K \J R K (j)(R l (t)) 

$(z,R l (t)) 



-V(z,y)f(z)dz Qt-x(y)dy 



>r k 4>{R\t)) 

Since / is the arbitrary function the identity [7] holds. 



^(z,y)g t -i(y)dy dz 



□ 



Appendix B. The constant vn in the error estimate in lemma [373 

Changing the limits of integration in the integral 

\x\~ p dx 

[M ,+oo) N 
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to the polar ones with 



F(w,a!, . . .,a N ) 



w cos ai cosa 2 cos a 3 . . . cosa:jv_i 
wsin ai cos a 2 cos a 3 . . . cosa:jv_i 
w sin 0:2 cos 0:3 .. . cos ajv-i 

w sin aN-2 cos ajv-i 
w sinaAr_i 



we obtain 



I 



\x\ p dx 



[M ,+oo)t 



r p \ det F'\dwdaia 2 • • • ®n-i 



[M ,+oo)x[0,27r]x[-f f]AT-2 



/ w p w N 1 / ldcti / cos a 2 da 2 ■ ■ ■ / (cosajv-i)^ 2 da A r_ 1 . 

J[M ,+oo) J[0,2tt] J[-ll\ -A-SSl 



Let us denote I n : = cos n tdt. Note that I — n and l\ = 2. Integrating 
by parts 



cos t cos™ 1 tdt = sin t cos™ 1 1 



n-1 . 



+ / sin^t cos™" 2 tdt 



+ nl n -i - nl n , 



(B.l) 



thus 



n = 2k 
n = 2k + l 



nil 



7T, 



/n = 2 



(n + 1)!! ' 
n\\ 



n + 1)!! 



Then 



2tt 



AT-l 



V N = 



\ - - 11 - 1 

r j=2 J I- 2 ' 2J 



COS 



*) J ' _1 dt 



2tt 



JV-2 



AT 



n 9 imod2 + l)mod2 -7" 

(2tt 



2tt 



(JV-p)(JV-2)!! 



2tt 



JV-2 
2 , 



2^7r^+\ ifiV = 2A; + l 



if JV = 2k 



(N-p)(N-2)U 



(B-2) 
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